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ABSTRACT 


The smart fitness mirror proposed in this researchaims to provide the users 
with a platform to monitor their health and fitness status on a daily basis. 
The system employs a number of sensors to monitor the body mass index 
(BMI) and amount of body fat present in the user’s body. A weight scale 
consisting of four load sensors has been implemented to obtain the weight of 
the user whereas an ultrasonic sensor has been used to measure the height of 
the user. In addition, four electrode plates have been implemented on the foot 
weight scale to infuse a small amount of electric current (ImA) for BIA 
(bioelectrical impedance analysis) to estimate the amount of body fat 
percentage, lean body mass and total body water. An IR temperature sensor 
has been implemented in the research to measure the temperature of 
the user’s body from the forehead. Tests conducted on the system illustrate 
that it is able to accurately compute the body mass index and perform a 
bioelectrical impedance analysis on the user. The system is able to achieve a 


92.5 % and 93.7 % accuracy in determining the body mass index and body 
fat percentage respectively. An accuracy of 95.3 % was observed in 
the determination of the body temperature. 
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1. INTRODUCTION 

With the massive advancement in IT field such as Internet of things, cloud computing, and data 
analytics, self health care (SHC) is getting polpular a day after day. Self health care (SHC) refers to all 
the activities carried out by the indivduals to monitor their health without professional assistance relying on 
advices and past experiences [1]. Nowadys, self health care (SHC) became recently a growing industry all 
over the world [2] particularly, with the massive availability of smart and werable devices. SHC gains its 
importance from the considerable reduction in costs that may be incurred for patients and also for caregivers’ 
companies [3, 4]. No extra charges related to hospitalization, transportation, and facilities. The hospital 
providing HHC services will reshape the regular consultant with high quality of satisfaction care for patients. 
In [5] authors conclude that SHC services are less expensive compared with the hospital services. 

Providing medical service at home and away from traditional healthcare facilities was enabled by 
several enablers mainly information technology (IT) [6, 7]. IT technologies disrupting healthcare fields 
include internet of things (oT) [8-12] named also internet of health things, body area network [13], cloud 
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platforms [1, 14], big data [14, 15] and service robotics and drones [16, 17]. A variety of IT enabled HHC 
solutions were proposed such e-health [5], smart health care and smart environments like SPHERE and 
PLAIMOS, we-care, careNet and BESI [8, 9, 12, 16-19], m-health [10] and tele-health [14]. 

Millennials in today’s society are constantly distracted with various issues in the developing society 
that little or no attention is directed towards maintaining a healthy lifestyle. Poor lifestyles characterized with 
poor eating habits, fitness routines and rest have made most people in the current centuries prone to health 
risks and issues. Besides, the wrong habits may cause a siginifacnt increase in chronic diseases. Thus, health 
issues related to poor fitness have become a raging problem in the current world whereby a variety of 
life-threatening ailments and diseases are being detected each day. Most of the health issues experienced 
daily originate mainly from poor eating habits, lack of exposure to health and fitness exercises [20]. In the 
past a lot of efforts have been made to ensure that these diseases are controlled and treated with ease such as 
conducting frequent visits to the doctor and ensuring that proper feeding habits such as strict diets are 
followed. But in order to achieve this early detection of the diseases is required through efficient periodic 
monitoring and collection of health/fitness data. Acquisition of periodic real time fitness and health data is a 
complex task that is significant in order to identify health issues affecting the user. One way of ensuring that 
health/fitness data of the user is accessed is by integrating an IoT based smart mirror technology and wireless 
sensors in monitoring the real time health/fitness state of the user as proposed in this study. 

This study highlights the development of a smart mirror that is connected to smart devices for 
the purposes of offering advances functionality such as monitoring the health of its users. The proposed smart 
mirror will help in providing an innovative unique platform for users to monitor their health fitness status 
with self-adapting features by employing wireless smart sensors and computer vision. A number of 
literatures has been reviewed based on the development and application of smart mirrors. Various researchers 
have utilized several approaches to develop smart mirrors based on IoT using Raspberry pi. The studies 
proposed in the literature reviewed have included some features such as time, date, news, weather updates 
and calendar. Little or no effort has been made on development of fitness and health based smart mirror 
except for two studies which monitor the user weight only. Therefore, this study will focus on the 
implementation of fitness features and health monitoring as well as face recognition to allow the system to 
continuously monitor the health of a particular user over time. Thus, some of the research questions that will 
be considered in the development of the proposed fitness monitoring system include: 

— What traits will be used to monitor the health/fitness of the user? 

— What sensors will be used to collect real time health/fitness data? 

— What type and size of mirror will be used? 

— What IoT technology will be used to send and receive health/fitness data? 

— What techniques will be used to identify a particular user? 

— What type of embedded hardware system will be used to analyze the health/fitness data? 


2. RELATED WORKS 
2.1. Self health care systems 

In this section we discuss the way to construct a self-diagnostic system. Mime [10] is a home 
tablet-based movies system added to augmented reality subsystem. The author reported the user experience 
with such setup in both assisted and un-assisted using "blood testing" experiments. He described the user 
experiences in using the movies to guide the patients. 

Atallah et al [11] proposed a home assistant system to adapt to needy older patients to improve their 
autonomy at home, and lessen their dependence on other people. The solution is proactive home monitoring 
system that adapts to user habits. They used classification and clustering algorithms for activity recognition. 
Authors in [12] described a cloud-based smart home environment for home healthcare. They used IoT 
devices to collect data through home wearable sensors and medical contextual data. A smart home gateway 
was then used to send these data to a private cloud. This cloud was make available to remate healthcare 
providers. In [13] Hossain et al proposed a smart home health care system for elderly people. The system 
uses multimodal speech, and video along with other IoT's sensors to continuously capture these data stream 
to a private cloud. Classification scores are computed in the cloud on the patient condition and conveyed to 
the caregivers. Another system based on cloud technology was discussed in [15]. Cloud assisted body area 
network for smart home healthcare used by home patients. It stores, process, and analyse data streams from 
the wireless smart home IoT devices. They presented a cloud resource allocation strategy based on 
agent-based modeling and ontology to support diverse CABAN applications. Morover, an emotion-aware 
connected healthcare system [18] used different IoT devices to collect streams of data from patient in a smart 
home healthcare facility. This was fed into an emotion detection algorithm. Both speech and image data were 
used. They then fused to produce final scores of the emotion. 
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Verissimo et al [14] presented a ubiquitous healthcare and activity monitoring system through 
recognizing patient's real-time activities. The proposed system is based on spatiotemporal mining technique 
to build an activity prediction model. A micro-aggregation approach was used to enhance the privacy of 
the collected approach human sensed data. A smart in home monitoring system [21] was implemented to help 
elderly and track their actions. It is an IoT sensory system run by a fuzzy controller. The set of fuzzy rules are 
written by specialized medical staff. The rules specify a fusion based architecture. A similar system was 
presented in [22] using a convolutional neural network model for patient consultation. It has high disease 
diagnosis performance. It enables self-checking of the user's health condition and flow up with him on a 
regular basis. Certain main symptoms, possible diseases can be pre-diagnosed. 

O’Connor, & Andrews [16] presented a framework to assess the quality of online health portals in 
Asian countries against HON standard. Their study considered Japanese, Korean, Chinese, and Malay. 
The result showed that only the Japanese websites have highly met HON standards. Authors in [17] 
presented an encyclopaedia of symptoms/diagnosis in Chinese by fusing medical data extracted from 
mainstream Chinese healthcare websites. Sadid Hasan et al [18] has proposed a knowledge graph clinical 
diagnosis algorithm that fused medical knowledge collected from various sources. The system was proven 
effective when compared to the state-of-the-art deep learning clinical diagnosis systems. 

The issues of security, privacy of medical healthcare records were addressed in [16-19] particullary 
in wireless setups. Maria et al [23] used k-medians clustering technique with subsample validation to flatten 
medical records into the patient level. Authors in [17] presented a classification method to classify medical 
text data found in medical records. They used neural network algorithms for named entity recognition in 
Chinese electronic medical records. In [19] authors have identifies clinical concepts automatically from 
medical records using OCR and applied quantitative analysis. Data were collected from medical notes, 
lab test, and other outside medical records for verification and validation purposes. 


2.2. Internet of healthcare things 

The Body area network in [24] is the front end of mobile healthcare in the new personalized 
healthcare trend. Varity of body sensors are used to aquire signals from the patient and transfer them to 
his/her mobile phone for collective processing of data. Several mobile medical apps were test and verified. 
The work in [24] examines a number of FDA-Approved mHealth products in the market classified into seven 
areas (see the chart above). USA, China, Taiwan, Australia, Canada, New Zealand, and Netherlands are 
among the largest producers to such products. 


2.3. Mobile healthcare/medical apps 

Medical Health programs suffers with accuracy of their alarms, Ben Amor and Lahyani tried to 
reduced false alarms signals generated by medical health programs and apps with using statistical methods to 
decrease the dimensions of alarm generating factors while simultaneously preserving the relevance of 
medical health program itself. They incorporated incremental principal component analysis to reduce 
the dimensions along with multivariate anomaly detection based up on squared prediction errors and 
anomalous vital sign isolation for contribution graph [25]. 

Sarwar et. al. discovered a strong correlation between use of smart phone/devices and data 
transferred to health care providers through these devices. MHealth apps are dramatically changing 
the senarios of clinical care. This new setup is much lower in cost and ease of use than existing setups [26]. 
Sodhro, Luo and Sangaiah investigated ways to optimize medical data communication techniques over 5G 
networks. This is needed for medical data visualization, high sensing levels, and better quality of service. 
Window based rate control algorithm is suggested to optimize such techniques. This is sometimes called edge 
computing based health care. In such setup, network parameters used were ‘peak-to-mean', standard 
deviation, delay, and jitter [27]. Onodera and Sengoku, studied market scope of mobile health (mHealth) 
programs, their study reveals Europe is currently leading in mHealth initiatives and market partially because 
of heavy investment and initiatives by various government agencies, however market trend predict strong 
growth signals from Asia Pacific region and Latin America as well during upcoming years [28]. 

A business intelligence assessment published by BIS research viz. "Global mobile medical apps 
market - analysis and forecast, 2017-2025" world mobile medical app market is steadily growing for last few 
years and is estimated to grow further with persistent, current socio-economic factors in near future. 
Estimated value of global mobile medical apps was 1.40 $ billion during year 2016 and is projected to swung 
by 11.22 $ by years 2025. Driven by rapidly increasing smartphone market and exponential penetration of 
mobile phones in individual lives, reliable and cheap network connectivity with advance 4/5G connections, 
investment by governments, mHealths initiatives will certainly improve the QoS into mobile health care 
segment [29]. 
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2.4. Smart mirror in SHC applications 

Nowadays technology has been enhanced to make human’s life better and easy. There are many 
technologies utilized in smart mirror such as deep learning, artificial intelligence, IoT and cloud. 
The reasearchers in [30] have proposed a smart mirror for physically challenged people based on IoT. 
The proposed system can manage their time and routines effectively and daily. The main idea of the work 
was to design smart mirror system based Raspberry Pi along with a voice recognition system that can 
facilitate the carrying out of smart mirror. Lastly, the proposed system implemented all kinds of real 
technologies that can help the users to manage their time. 

Yusri et al, [31] proposed a smart mirror for smart life researcher comes with a proposed system 
called smart mirror. The idea behind the proposed it is based on IoT and the system allows users to access 
information as well as control the house lights. The implemented method in the system is evolutionary 
prototyping which collects all requirements and designs the system in a fast way. The testing has been 
evaluated with the term of "fail" and "success" in order to know whether “the field has performed well or 
resorted into failure. Lastly, there are some limitation in [31] such as the system needs improvement in order 
to implement a new technology on smart mirror and implemented other functionality that has been proposed 
in [30]. Another work was proposed by [32] which has discussed the fit mirror, a smart mirror for healthcare 
living. The idea behind this fit mirror is to affect the feelings of the user in a positive way by a rise of his or 
her, mood motivation and feeling of fitness. According to the expermintal results stated that fit mirror can 
help people to get awake in the morning, and raise their motivation to do sports. Besides, the investigation 
results stated that among 43 users 839 valid sets of workout data were retrieved. Nevertheless, due to 
technical problems the data from two participants could not be used for all hypotheses. Moreover, 
the participants were divided into three unlike types of athlete, which are 11 participants (26.83%) had high, 
24 middle (58.54%) and 6 low degrees (14.63%) of sports motivation. Reaserachers in [33] has presented a 
“wize? mirror, “a platform for the estimation of cardio-metabolic risk from sensed facial data and 
the delivery of personalized user guidance towards lifestyle change”. The proposed “wize” mirror has an 
advanced sensing features agenda for unremarkable purchase of videos, images, and 3D scans of individuals 
standing in front of the mirror. The “wize” mirror involve a multispectral, a visible camera, imaging system, 
a breath analysis standard devices and 3D optical sensors. Thus, the multispectral imaging system helps to 
analyze the microcirculation and skin tissue. For emotional analysis visible cameras has been utilized, in 
order to dedicate the anxiety, stress and fatigue from capturing video sequences. A 3D scan implemented to 
scan the face change. Thus, there were many limitations such as the accuracy of the proposed system 
was low. 

Maheshwari, Kaur & Anand [34] proposed a reflective interface to maximize productivity, smart 
mirror. The proposed study presented a new design and development of a smart mirror that signifies an 
elegant interface for slanting information for multiple people in a home environment. A face recognition 
approach was utilized in the proposed smart mirror. The system delivers a webpage services in order to 
access information feeds to the mirror. The system developed included a Raspberry pi 3, computer and a 
webcam for face detection was utilized as well as LCD panel in order to show the interface. Therefore, 
the main key features and the working principle of the proposed system as follow, a webcam used behind 
the mirror facial recognition to recognize the person who is standing in front of the smart mirror. The open 
CV platform used for machine vision programing. Lastly, the main limitation of the proposed system 
sometimes the mirror cannot recognize the user face or other user can access the sensitive data for other 
users. This study needs to enhanced the facial recognition by add a high security. Another research done 
by [35] has presented an interactive smart mirror based on IoT platform and Raspberry pi 3. The proposed 
smart mirror was designed to bring technology seamlessly into people’s lives to manage their time and daily 
routines. This system used for user productivity and effective time management. This mirror work on voice 
recognition to be easy used and it accept natural language. Based on the concept of IoT that has been 
implemented in the proposed system, the user could communicate with the environment of the living-room 
around him easily. Moreover, in the developed GUI it has been design some icons such as holidays, time 
date, weather and news. However, there were some limitations in the proposed system, for example when 
the user asks the smart mirror about the data needed the system take few minutes to response. Also 
the system required a good internet connection. 

Moreover, the authors in [35] proposed an interactive smart mirror with various features to make 
sure that every minute of the user is utilized properly. The proposed smart mirror allows users to use a home 
object as an interactive interface providing customizable services. The main advantage of this mirror is to 
track the health of the user which results in a healthy life. The developed mirror able to display the real time 
information like the weather, the particular location and day today schedule as well as the news happening 
around the world. Besides, the most important feature in the proposed mirror is the weight tracker that can 
tracked the user weight and make sure that the user is fit and display weight of the user in the daily basis. 
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Furthermore, the system can also be utilized the window blinds and control lighting in the room based on a 
control of single point. Another advantage of this system that the weight and other health conditions can be 
checked live at whatever point the user remains on a heap cell incorporated stool. This will have the capacity 
to propose and propel the user to decrease weight if needed. 

Siripala et al. [36] proposed a magic smart mirror to monitor children while their parents at work. 
The smart mirror developed based on IoT and it implemented Raspberry pi. This mirror also implemented a 
smart technology which has the ability to show the details to the user using a smart phone with android 
application. The researchers stated that the proposed smart mirror is very different from the other mirror that 
has been developed previously with few features such as time, date, news and weather or even the weight and 
other health conditions. The Raspberry magic mirror is more advanced and interactive which allows 
the parents to keep tracking their children even though they are in the work, they can get notification to their 
smart phone using IoT approach that has been implemented in this study. 

Therefore, reaserchers in [37] describes a new design of interactive mirror. The developed smart 
mirror identifies the user according to the image processing approach and provides a health progress 
representation. Besides, the health parameter measurement and analysis help the user in leading a healthier 
life. Furthermore, there several features have been extracted in this system such as emotion recognition, 
mouth feature extraction, and health progress representation and mirror usage time. It has been tasted each 
part in order to analyses the performance of the proposed system. However, the system has been trained with 
42 images for 9 different people and the result of the system was vary from one to another which means 
the system cannot recognize some user and display a satisfactory result. Besides that, the system can be 
enhanced by add some advanced functionality such as speech processing. Lastly, the accuracy of the emotion 
recognition approach need be improved by extracting additional feature like eye feature. 

In summary, smart mirrors commonly allow users some customization in order to bring a 
personalized service, a smart mirror needs to identify the user who is standing in front of it. Thus, it could 
access and display the user’s personal information like his or her schedule in order to do appointments. 
Automatic approaches for identifying users include face recognition [38, 39], tag-based identification, 
biometric data, and personal belongings such as toothbrush [40]. 

A different work [41] proposed the implementation of anthropometry and bioelectrical impedance 
analysis as interchangeable techniques for assessing body health of sports persons. In the anthropometry 
analysis various instruments and equipment were used to compute body density, weight and height which 
were used to compute body fat percentage. in order to compute bia, a foot scale was used consisting of two 
electrodes placed parallel to each other, to allow the users feet to be exposed to the low induction current for 
impedance analysis. Testing was conducted on 83 sports athletes whereby the percentage of body fat was 
estimated using BIA and anthropometry analysis. The internal consistency of the BF data was measured 
using Pearson’s correlation. Results from the tests conducted illustrate that a better correlation coefficient 
was achieved using bioelectrical impedance analysis 1.e. 14.78 + 9.29 whereas the anthropometry analysis 
produced a correlation coefficient of 13.08 + 5. 

The design and analysis of adjustable constant current source with multi frequency for measurement 
of bioelectrical impedance has been proposed by [42]. In this research a hand and foot scale analyzer were 
used for bioelectrical impedance analysis whereby electrodes used for measurement were placed as the front 
and rear soles of the leg whereas the palm and thumb were used as electrode contacts for the hands. A similar 
work to [41] proposed by [43] in order to use of bioelectrical impedance analysis to study the reference 
values of a given population based on their phase angle, age and sex. BIA was used in this study to compute 
reactance and resistance which was then used as a phase angle indicator. The fat mass was then estimated 
from a series of parameters consisting of total body water, weight and hydro densitometry which were then 
implemented in the Siri equation. The phase angles obtained from the equation were then compared over 
different ages, sexes, body mass index (BMI). Findings from the research conducted by [41] showed that arm 
posture played a significant role in computing BIA values. Bent arm posture affected the flow of the current 
whereas stretched out arms produced better results with an accuracy of 92.4% and mean difference of 
+ 0.87%. In addition, the system was able to work efficiently between frequencies of 50 and 100 kHz, with 
the best results obtained at a frequency of 85 kHz. The researchers however recommended that further 
research should be conducted to study the impact of electrolyte wipes on the effectiveness of bioelectrical 
impedance analysis. 

In [44] a comparison of different techniques used to measure body composition was conducted. In 
this research, two techniques were used as case studies 1.e. bioelectrical impedance analysis (BIA) and air 
displacement plethysmography (ADP). Testing was conducted on 41 participants on two different occasions 
after an overnight fasting period with no water and food. Measurement of the height, weight and percentage 
of body fat was then carried out using the two approaches i.e. BIA and ADP. The skinfold in (1), (2) and (3) 
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were then used to calculate the percentage of BF (body fat) based on the values derived from the two 
approaches i.e. FFM (fat free mass (Kg), H (height (cm), BW (body weight (Kg), R (resistance (Q). 





2 
FFM = —10.68 + er ) + 0.26W + 0.02R (1) 
FM = BW — FFM (2) 
% BF = — x 100% (3) 


The results obtained from the tests illustrate that both systems have a high correlation between them 
whereby the mean difference observed from BIA and ADP was 3.1% and 4.1% respectively whereas 
the accuracy was 83.2% and 78.4% for BIA and ADP respectively. The test data from this research indicated 
that the bioelectrical impedance analysis (BIA) approach was better than the air displacement 
plethysmography (ADP). In [45] a bioelectrical impedance analysis system has been proposed to evaluate the 
health of poultry and eggs. BIA was selected by the researchers since it presents a painless and more accurate 
and non-invasive approach of measuring poultry health at different stages of their life cycle. During testing 
four values were measured using the bio-impedance apparatus i.e. resistance, reactance, egg weight and 
phase angle. The phase angle and impedance values obtained from the bioelectrical impedance analysis were 
also used to differentiate the sex of the poultry in eggs. Results obtained from the study illustrate that the BIA 
approach is able to accurately predict the sex and health of the eggs and poultry with a correlation value of 
0.739 at p < 0.05. 

To conclude, a number of literatures has been reviewed based on the development and application of 
smart mirrors. Various researchers have utilized several approaches to develop smart mirrors based on IoT 
using Raspberry pi. The studies proposed in the literature reviewed have included some features such as time, 
date, news, weather updates and calendar. Little or no effort has been made on development of a fitness and 
health based smart mirror except for two studies which monitor the user weight only. Therefore, this study 
will focus on the implementation of fitness features and health monitoring as well as face recognition to 
allow the system to continuously monitor the health of a particular user over time. 


3. PROPOSED SHC SYSTEMS 

The proposed smart health/fitness mirror system uses the facial recognition technique to access 
the historical health data base of the user whereas a network of sensor is used to obtain real time health and 
fitness data from the user as shown in the block diagram in Figure 1. A health monitoring is then performed 
based on the user’s previous health history whereby the diagnosis and the sensor data are displayed on 
the smart mirror. 





Use sensors for 


database analysis 


Motion sensor 





Health/Fitness 


analysis 


Figure 1. Health/fitness monitoring system block diagram 


3.1. Face recognition 

According to Zhang et al. [46] face recognition refers to the process of mapping the face of a given 
individual to their identity. The facial recognition system implemented in this study was used for purposes of 
identifying the user. Identification of the user enables the system to compare the current health status of 
the user with previously obtained historical data. A USB web cam was used for the purpose of image 
acquisition whereas a Raspberry pi 3 fitted with OpenCV was used to develop the face recognition algorithm. 
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After the process of acquiring the user’s image is complete, feature extraction is carried out to isolate keen 
areas of interest based on his/her facial features. Conversion of the acquired image from RGB to gray scale 
was then carried out in order to allow the edges of the retrieved image to be found through the process of 
edge segmentation as shown in Figure 2. Eigenvectors were then employed for reconstructing facial features 
from the edge map before face localization was done. Face localization was done in three steps as 
explained below: 

— Haar-feature selection stage, whereby the digital features extracted from the face such as eyes, nose and 
mouth are set apart from the facial image. 

— Face vector normalization, whereby the face vector average from each Eigen value are manipulated to 
lower dimension vectors with the aim of calculating the overall dimensions of the digitized facial features 
obtained during the previous stage i.e. Haar-feature selection stage. 

— Face identification stage, whereby the extracted facial dimensions from the previous stage and the Eigen 
values are used for purposes of comparing with other facial images hosted in a database. In this stage, 
cascading classifiers are employed for the process of classifying the images selected. 






s the users face, a Error !! 
recognized ? User not identified 





Face extraction, edge 
segmentation & Filtering 






Face Localization using Eigen 
faces and OpenCY 


TRAINED 
DATA BASE 


Figure 2. Image processing flowchart 


3.2. Health/fitness monitoring 

The health fitness system implemented for the smart fitness mirror relies on information obtained 
from a network of wireless sensors as shown in Figure 3. The IR temperature sensor was used to obtain 
the temperature of the identified user, whereas the weighing scale was used for BIA (bioelectrical impedance 
analysis) and BMI analysis. Once the user steps onto the weigh scale, a camera takes a photo of the user to be 
processed for identification purposes. Once the user is identified, his/her health data is accessed from 
the data base for comparison with the computed BIA, BMI and body temperature information. If the results 
obtained are suitable, they are displayed on the smart mirror. However, if the results are considered not to be 
in the range set, then the results are displayed with recommendations to allow the user to adjust his 
health/fitness. The body mass index of the user was calculated using (4) as proposed by Kim et al. [47] and 
Frank [48]. 


Weight in Kilograms 


BMI = (4) 


(Hieght in meters )? 


BIA (bioelectrical impedance analysis) was used to estimate other health properties of the user such 
as body fat percentage, lean body mass and total body water as shown in Figure 4. According to 
Maria et al. [43], BIA measures the amount of opposition (impedance) offered by body tissues to the flow of 
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a small amount of Ac current i.e. less than 1 mA. The amount of impedance measured varies with 
the frequency of the current applied i.e. 50 kHz for each frequency. Two bio-electric electrodes were 
installed at the base of the weighing scale for purposes of performing BIA (bioelectrical impedance analysis) 
as shown in Figure 3. According to InBody [49], to perform BIA, the body was divided into 3 main sections 
1.e. trunk, right leg and left leg as shown in Figure 4, whereby the impedance (Z) of each section was 
computed as shown in Table 1, 


START 






Health DATA BASE 


= BLA bistery 






User Recognition (Face recognition) 






- Weight history 





- Body Temperature 





Figure 3. Health monitoring 


Table 1. Impedance of various body parts 


(T 


Z (Q) runk) (Right Leg) (Left Leg) 
26.8 





1 kHz l 306.8 316.1 

5 kHz 25.7 303.0 314.1 
50 kHz 23.0 282.3 289.8 

250 kHz 20.4 263.3 272.7 

500 kHz 19.1 258.1 267.8 

Left leg 1000 kHz 17.0 254.5 264.0 





Figure 4. Bioelectrical impedance analysis 


3.3. Fat free mass (FFM), free mass (FM) and body fat (BF) calculation 
In (5), (6) and (7) as proposed by Kim et al. [47] and Frank [48] and InBody [49] were used to 
calculate the fat free mass (FFM), free mass (FM) and body fat (BF) for the users respectively. 
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2 
FFM = —10.68 + (= ) + 0.26W + 0.02R (5) 
FM = BW — FFM (6) 
% BF = —~ x 100% (7) 


FFM -— fat free mass (Kg), H — height (cm), BW — body weight (Kg), R — resistance (Q) & BF — body fat 


3.4. Electrical construction 

The electronic components used for the development of the system are as shown in the electrical 
schematic in Figure 5. The smart mirror developed relies on a WIFI connection and therefore a Raspberry pi 
3 on-board computer was used to provide internet connection and act as the sole microcontroller used to 
retrieve and transmit data from the sensors and weight scale. The HX711 module was implemented in 
the system to amplify the signal of the load cell used to measure the overall weight of the user. The analog 
signal produced by the load cell was weak and therefore the HX711 module was implemented to convert 
the weak signal into bits and bytes for easy interpretation by the Raspberry pi microcontroller. An LCD TV 
monitor display with HDMI connection was used to display user’s personal information such as emails, 
weather forecast, Quran quotes, upcoming events, news feed and health data processed from the health 
monitoring system. The double-sided mirror proposed in the beginning was deemed quite expensive after 
further research and analysis, therefore a tint film normally used for car and building privacy was used to 
provide a two-way reflection of the user and relevant fitness information from the LCD screen. 

In addition, a DHT11 temperature sensor was used to read and record the environment temperature 
1.e. temperature of the room, to enable the user to be aware of the room temperature and make necessary 
adjustments to the HVAC system. However, an IR temperature sensor was used for purposes of obtaining 
the body temperature of the user. An infra-red temperature sensor was used in comparison to other 
temperature sensors since it does not require the user to be in contact with-it during operation. In addition, IR 
temperature sensors are known to be more accurate, precise and wear free since there is no physical contact 
with the user. The temperature obtained from the body would then be compared with previously collected 
values in order to obtain a conclusion i.e. if temperature is normal or abnormal. The hardware system 
developed for the smart fitness mirror consists of a Bluetooth enabled weighing scale and a smart mirror. 
The weighing scale was made from 3D printed material and measures 30.3 cm by 35.2 cm by 4.8 cm. Four 
load sensors located at the four corners of the weighing scale were used to measure the weight of the user as 
shown in Figure 6. 





Figure 5. Electrical schematic Figure 6. Weight foot scale 


Furthermore, four stainless steel electrode plates also located at the four corners of the weight scale 
above the load sensors were used for BIA (bioelectrical impedance analysis) in order to calculate other health 
properties of the user such as body fat percentage, lean body mass and total body water. The smart mirror 
developed measures 45.2 cm by 115 cm by 6.7 cm and consists of an LCD screen mounted onto a wooden 
frame and covered with a thin film of window tint to produce the effect of a double-sided mirror. 
The complete system has been reconstructed and tested for the purpose of proving its fubctionality and 
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performance. Figures 7, 8 and 9 depict the running system. The android application developed using android 
studio for body health and fitness tracking is as shown in Figure 10 and Figure 11 where the idntifcation of 
the user, body weight and fat shown in the developed mobile app. Also, the Raspberry pi GUI for the smart 
fitness/health monitoring mirror is as shown in Figure 12. 
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Figure 7. Foot scale and smart mirror 
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4. RESULTS AND ANALYSIS 

The smart fitness mirror developed was tested and the results obtain that face recognition 
system was able to correctly identify the user and thereby allow access to the user’s historical health data as 
shown in Table 2. However, if the user was not recognized, the system would issue an alert message 1.e. 
“user unknown’. Once the user was recognized, the BMI and BIA analysis was conducted using 
the information obtained from the weigh scale and computation algorithm. The results were displayed on 
the mirror as shown in Figure 12. Several tests were conducted on different sections that make up the smart 
fitness mirror system as listed below: 


Table 2. Smart fitness mirror user identification 


Ba 











4.1. Weight identification test 

A weight identification test was carried out to analyze the ability of the system to accurately identify 
various weights loaded onto the weighing mechanism. Accurate weight identification was important since 
the weight of the user was used to compute BIA and BMI. The four load sensors were strategically located on 
the weighing mechanism as shown in Figure 13. A normal weighing scale was used to obtain the theoretical 
weight of the user for comparison with the value obtained from the implemented system. 

The theoretical and measured weight of the users was obtained and recorded during the expermint 
conducted. The weight reordered was measured from both male and female users. Results obtained from 
the weighing system showed that it was able to identify the weight of the user irrespective of the gender. 
However, some discrepancies were observed whereby an error of + 0.2 was observed for some measurements 
as shown in Figure 14. In addition, as the weight of the user increased, the accuracy of the system reduced 
slightly; especially for users weighing above 100 Kg. On further research it was observed that the load 
sensors used for the system have a weight limit beyond which the accuracy and resolution of the sensors is 
affected. Therefore, the maximum weight threshold set for the developed weighing scale was 110 Kg, beyond 
which the system will give errors. 
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Figure 13. Weight scale with load sensors Figure 14. Gender vs weight graph 


4.2. Height identification test 

According to Gin et al. [50], the height of a person is the distance from the head to the toe of 
the individual. The height was used to compute the body mass index and the BIA (bioelectrical impedance 
analysis) of the user. Therefore, accurate height identification was important in order to compute accurate 
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BMI and BIA. The height of the user was obtained using an ultrasonic sensor placed on top of the weight 
scale. Different users of different height were used for this test whereby their theoretical and measured height 
was tabulated as shown in Figure 15. However, a slight deviation was observed between the measured and 
theoretical height of the users. This deviation was observed due to the uneven head surface which affected 
the reflection of ultrasonic waves off the surface. In addition, the uneven strands of hair with air gaps enabled 
the absorption of the ultrasonic waves thereby leading to some minor errors. 
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Figure 15. Height test data 


4.3. Temperature test 

Body temperature has been used a measure of body health over the decades and still remains a vital 
source of information related to health and body fitness [51]. Abnormal body temperature 1.e. above or below 
37°C is considered as a sign of illness or abnormal body activity. A non-contact infra-red temperature sensor 
was used to measure body temperature of the user standing in front of the mirror from the forehead. The 
theoretical temperature ranges for normal human body temperature are as follows: normal (36.1-37.8), fever 
(>37.8), and hypothermia (<36). The temperature of different users standing in front of the mirror was 
obtained based on different genders and distances away from the mirror as shown in Figure 16. The measured 
temperature of the users was then compared with theoretical temperature values which were obtained by 
means of a digital thermometer shown in Figure 16. 

Temperature data collected from the IR temperature sensor illustrate that the implemented 
temperature monitoring system is able to read human body temperature from the forehead. In addition, 
the system is able to categorize the health status of the user based on their temperature. The system was also 
exposed to manually control low and high temperatures since it was not possible to find a human specimen 
whose temperature was in these ranges. The system was able to respond in kind to temperatures below and 
above the set threshold whereby only a minor discrepancy was observed between the measured and 
theoretical values. 


4.4. BMI test 

According to Kim et al. [47], BMI is considered as an efficient technique of gauging the amount of 
fat present in the body since too much body fat can be life threatening. The body mass index (BMI) of a 
person is obtained as the ratio of body weight (kh) to the height (m). The theoretical ranges as proposed by 
health digest, [52] as follows: underweight: <18.5, normal: 18.5—22.9, overweight: 23-24.9, pre-obese: 
25—29.9, and obese: >30. A number of users with varying height participated in this experiment. 
The ultrasonic sensor was used to record height of the users whereas a weighing scale was used to compute 
their respective weights. The BMI was computed and the values obtained were recorded. The data obtained 
from the BMI test illustrates that the implemented system is able to monitor the body mass index of 
the users irrespective of their gender. However, a minor discrepancy was observed between the measured and 
theoretical values. The minor error observed was mainly from the minor deviation between the measured 
height and the theoretical height. This is because the implemented height measurement system relies on an 
ultrasonic sensor which operates based on the ultrasonic waves bouncing off the uneven head surface. 
Therefore, the user needs to be in a still position for at least 5 seconds for the ultrasonic sensor to take 
accurate readings. 
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4.5. BIA (bioelectrical impedance analysis) 

According to Gin et al. [50] BIA is a broadly and newly applied concept used in many health care 
assessment products and systems. BIA (bioelectrical impedance analysis) was used to estimate other health 
properties of the user such as body fat percentage, lean body mass and total body water. According to 
Maria et al. [43], BIA measures the amount of opposition (impedance) offered by body tissues to the flow of 
a small amount of Ac current i.e. less than 1mA. The amount of impedance measured varies with the 
frequency of the current applied i.e. 50 kHz for each frequency. During experimentation, the user stood on 
the weight scale developed, bare footed with both legs placed parallel on top of the stainless-steel electrodes. 
Then a small amount of Ac current i.e. less than ImA was sent from the electrode on the right foot, up the 
right leg, down the left leg and finally down the electrode on the left foot. The resulting impedance (Q) was 
then measured using the scale to be later applied in the calculation of Body Fat percentage. An ultrasonic 
sensor placed on top of the smart mirror was used to measure the height of the user. The theoretical body fat 
data used for the implemented system is as introduced in [48]. 

In (5), (6), and (7) was used to calculate the fat free mass (FFM), free mass (FM) and body fat (BF) 
for the users respectively. The theoretical percentage of Body Fat was obtained using a BIA foot scale. The 
data collected from the BIA test show that the system is able to compute the percentage of body fat present in 
the human body based on the impedance measured using the electrodes. However, a small error in the range 
of + 0.4 was observed during testing despite the error having minimum impact on the final result. It was also 
observed that the amount of body fat expressed as a percentage increased with increase in body weight and 
height. Figure 17 shows the difference between the theoretical BIA value and the measured value. 
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5. CONCLUSION 

To conclude, the system implemented has the ability to monitor the health and fitness of the user 
using an embedded hardware and software system. The robust system is also able to successfully achieve 
the aim and objectives proposed for this research. The smart fitness mirror system developed has a few 
limitations that were observed during implementation. The weight measurement system consisting of the four 
load cells can only measure a maximum body weight of 110 kg, beyond which, the system would produce 
errors. In addition, the load sensors cannot measure body mass less than 500 g. This limitation is mainly due 
to the sensitivity range of the load cell sensors. The bioelectrical impedance analysis carried out by 
the system relies on the contact of the human skin with the stainless steel electrodes in order to measure 
impedance. This means that the system can only be used if the user removes their shoes and climbs onto 
the weight scale. Further research can be conducted to develop a weight scale that can measure larger body 
masses, beyond the limit set. This would involve the use of more load cells with a wider measurement range 
as well as better sensitivity. A hand scale can also be embedded into the system for bioelectrical impedance 
analysis. The incorporation of a hand and foot scale into the health and fitness monitoring system would 
increase the accuracy of the system and provide a better body fat analysis platform. 
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